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Abstract 



The results of a search for flavor changing neutral currents in top quark de- 
cays t — > Zq in events with a topology compatible with the decay chain 
tt — > Wb + Zq — > £vb + ££q are presented. The search is performed with a data sam- 
ple corresponding to an integrated luminosity of 5.0 fb -1 of proton-proton collisions 
at a center-of-mass energy of 7 TeV, collected with the CMS detector at the LHC The 
observed number of events agrees with the standard model prediction and no evi- 
dence for flavor changing neutral currents in top quark decays is found. A t —¥ Zq 
branching fraction greater than 0.24% is excluded at the 95% confidence level. 
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1 Introduction 

The top quark decays with a branching fraction of nearly 100% to a bottom quark and a W bo- 
son, t — > Wb. However, some extensions of the standard model (SM) predict that the top quark 
can also decay through a neutral Z boson, t — > Zq, where q is a u or c quark. This decay occurs 
in the SM at the level of quantum loop corrections only, and the branching fraction B(t Zq) 
is predicted to be 0(1O~ 14 ) (H, far below the experimental reach of the Large Hadron Col- 
lider (LHC). Detection of this signal would therefore be an indication of a large enhancement 
in the branching fraction and clear evidence for violations of the SM prediction. There are sev- 
eral models, for example R-parity-violating supersymmetric models [2j and topcolor-assisted 
technicolor models [3], that predict enhancements of the t — > Zq decay where B(t — > Zq) could 
be as large as 0(1O~ 4 ). 

Previous searches for the flavor changing neutral currents in top quark decays performed at the 
Tevatron by CDF and DO determined aB(t-> Zq) upper limit of 3.7% gj and 3.2% at the 
95% confidence level (CL), respectively. At a center-of-mass energy of 7 TeV, the tt production 
cross section at the LHC at the next-to-leading order is 157.5 pb for an assumed top quark 
mass of 172.5 GeV, which is twenty times larger than that at the Tevatron at a center-of-mass 
energy of 2 TeV. This enables event samples with leptonically decaying vector bosons to be 
used. These samples have well determined backgrounds. A recent search in the three-lepton 
channels performed at ATLAS with an integrated luminosity of 2.1 fb _1 reported a B(t — > Zq) 
upper limit of 0.73% 0. 

We expect i3(t — > Zq) to be small and look for tt — > Zq + Wb — > ££q + £vb final state events, 
which produce three-lepton (eee, eeji, }ijie, final states. This choice results in a measure- 
ment with reduced background and fewer signal events. The analysis uses a data sample cor- 
responding to an integrated luminosity of 5.0 fb _1 of proton-proton collisions at \/s = 7 TeV, 
recorded by the Compact Muon Solenoid (CMS) experiment during 2011. 

2 The CMS Detector 

The central feature of the CMS apparatus is a superconducting solenoid, 13 m in length and 6 m 
in diameter, which provides an axial magnetic field of 3.8 T. Within the field volume there are 
several particle detection systems. Charged particle trajectories are measured by silicon pixel 
and silicon strip trackers, covering < (p < 2n in azimuth and \tj\ < 2.5 in pseudorapidity 
where rj is defined as — log [tan 8/2} and 9 is the polar angle of the trajectory of the particle with 
respect to the counterclockwise proton beam direction. A crystal electromagnetic calorimeter 
and a brass/ scintillator hadron calorimeter surround the tracking volume, providing energy 
measurements of photons, electrons and hadron jets. Muons are identified and measured in 
gas-ionization detectors embedded in the steel return yoke outside the solenoid. The detector 
is nearly hermetic, allowing energy balance measurements in the plane transverse to the beam 
direction. A two-tier trigger system selects the most interesting proton-proton collision events 
for use in physics analysis. A more detailed description of the CMS detector can be found in 
Ref. 0. 

3 Basic Selection 

Events with two opposite-sign, isolated leptons (e or y.) consistent with a Z-boson decay and an 
extra charged lepton are selected, e + e _ e ± ,e + e _ l w ± , ft + ji~ e ± , }i + }i~ }i ± . All three leptons must 
be isolated and have transverse momentum pj > 20 GeV, and the electrons (muons) must 
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3 Basic Selection 



have 1 7/| < 2.5 (\f]\ < 2.4). Events are required to pass at least one of the ee or jiji high- 
px double-lepton triggers. Their efficiencies for events containing two leptons satisfying the 
analysis selection are measured to be 99%, 98%, 91% and 93% for the eee, eep, p/ie and fifiji 
channels, respectively. 

Muon candidates are reconstructed with a global fit of trajectories using hits in the tracker and 
the muon system. The muon candidate must have associated hits in the silicon strip and pixel 
detectors, have segments in the muon chambers, and have a high-quality global fit to the track 
trajectory. The efficiency for these muon selection criteria is at least 99% HQ. 

Electron reconstruction starts from clusters of energy deposits in the electromagnetic calorime- 
ter, which are matched to hits in the silicon strip and the pixel detectors. Electrons are identi- 
fied using variables which include the ratio between the energy deposited in the hadron and 
the electromagnetic calorimeters, the shower width in t], and the distance between the calori- 
meter shower and the particle trajectory in the tracker, measured in both t] and (p. The selection 
criteria used are optimized |8] to maintain an efficiency of approximately 95% for the electrons 
from W or Z decays. 

The invariant mass of at least one e + e~ or pair is required to be between 60GeV and 

120 GeV. If two dilepton pairs lie in this mass window, the one closest to the Z mass is taken. 
Due to the high instantaneous luminosity of the LHC, there are multiple interactions per bunch 
crossing (pileup). Therefore, events are required to have at least one good primary vertex, 
which is chosen as the vertex with the highest Ep 2 of its associated tracks. All leptons, which 
are used to select or reject events, must come from the same primary vertex. The pair 
opening angle is required to differ from zr radians by more than 0.05 radians to reject cosmic 
rays. 

Electrons and muons from Z and W decays are expected to be isolated from other particles. 
A cone of size AR = a/ (A//) 2 + (A<J)) 2 = 0.3 is constructed around the lepton momentum di- 
rection. The lepton relative isolation is quantified by summing the transverse energy (as mea- 
sured in the calorimeters) and the transverse momentum (as measured in the silicon tracker) 
of all objects within this cone, excluding the lepton, and then dividing by the lepton transverse 
momentum. The resulting quantity, corrected for additional underlying event activity due to 
pileup events, is required to be less than 0.125 (0.1) for Z — > £ + £~ (W — > tv). This requirement 
rejects misidentified leptons and background arising from hadronic jets. 

The third lepton in the event should be the result of a leptonic decay of a W boson. In order to 
increase the electron purity, more stringent reconstruction requirements are used for W — > ev 
candidates. In this case the selection criteria are optimized |8l to reject the background from 
jets while maintaining an efficiency of 80% for the electrons from W or Z decays. Events with a 
fourth lepton satisfying the high-purity criteria are rejected. 

The jets and the missing transverse energy vector (— Epx) and its magnitude (Uj) are recon- 
structed using a particle-flow technique 0. An anti-/Cx clustering algorithm tlOl with a dis- 
tance parameter of 0.5 is used for jet reconstruction. The energy calibration [11 j is performed 
separately for each particle type in the jet, and the resulting jet energies require only a small 
correction accounting for thresholds and residual inefficiencies. In addition, a correction for 
pileup is included and jets are required to satisfy identification criteria that eliminate jets orig- 
inating from noisy channels in the calorimeters (121 IT3| . Jets are required to have pj > 30 GeV, 
\t] | < 2.4, and to be separated by AR > 0.4 from leptons passing the analysis selection. Neutri- 
nos from W-boson decays escape detection and produce a significant momentum imbalance in 
the detector. We require the missing transverse energy to be larger than 30 GeV. 
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Table 1: Event yields and background predictions based on simulated events for all three- 
lepton channels after the basic event selection, which includes the trigger, Z boson, third lepton, 
fourth-lepton veto and missing transverse energy requirements for an integrated luminosity of 
5.0 fb _1 . The uncertainties include the statistical and systematic components separately (in that 
order). 



Channel 


W e 


hw 


eee 


eeji 


Drell-Yan 


2.0±0.9±0.3 


0.9 ±0.6 ±0.1 


2.8 ± 1.1 ± 0.4 


0.9 ± 0.6 ± 0.1 


WZ 


46.1 ± 0.3 ± 6.1 


60.3 ± 0.4 ± 8.0 


40.9 ± 0.3 ± 5.4 


48.6 ± 0.4 ± 6.4 


ZZ 


17.7 ±0.2 ±2.3 


21.7 ±0.2 ±2.9 


15.1 ±0.2 ±2.0 


18.2 ±0.1 ±2.4 


WW 


< 0.001 


< 0.001 


0.18 ± 0.06 ± 0.01 


< 0.001 


tf 


< 0.001 


0.5 ±0.2 ±0.1 


0.9 ± 0.5 ± 0.1 


0.9 ± 0.4 ± 0.1 


Single top 


< 0.001 


0.14 ± 0.09 ± 0.02 


< 0.001 


< 0.05 


Total 


66 ± 1 ± 7 


84 ± 1± 9 


60 ± 1 ± 6 


69 ± 1 ± 7 


Observed 


73 


87 


85 


61 



The samples of Drell-Yan events with invariant mass of lepton pairs mg£ larger than 50 GeV, 
SM tf, and WZ are generated using MadGraph HU- The samples of WW and ZZ diboson 
events are simulated using pythia [15|, while single top quark events are generated using 
POWHEG [fl6HT8| . The signal sample pp -> tf -> Zq + Wb -> £ + £~q + £ ± vb (£ = e,}i) is simu- 
lated using MadGraph. The set of parton distribution functions used is CTEQ6L \\9\. The 
CMS detector response is simulated using a GEANT4-based 11201 model, and the events are 
reconstructed and analyzed using the same software used to process collision data. The sim- 
ulated events are weighted so that the trigger efficiencies, reconstruction efficiencies and the 
distribution of reconstructed vertices observed in data are reproduced. 

The observed and expected yields after the basic event selection described above are listed in 
Table [TJ The initial data sample of 1.3 (1.6) million Z to ee events is reduced to less than 
100 events per three-lepton channel. The Drell-Yan entry in Table [l] also includes the t + t~ 
decay mode. Single top quark production is dominated by the Wt channel. The total yields are 
dominated by diboson production and a reasonable agreement is observed between data and 
simulation. The details of the background estimations are discussed in Section |5j 

Figure [ljshows the distributions for data and simulated events of the missing transverse energy, 
transverse mass of the W boson candidate (mj), and the scalar sum of the transverse energy 
Sj, after the trigger, Z boson, third lepton, fourth-lepton veto, missing transverse energy, and 
the additional requirement of two or more jets. The Sj variable is defined as Ep T( ? + Epj; + 
where only the three leptons and two jets from the tf candidate are considered. The nij is 
calculated using the transverse momentum and azimuthal direction of the third lepton and the 
magnitude and direction of the missing transverse energy, as y / 2px£^i(l — cos(A</>)). 

4 Signal Reconstruction 

For the t — > Zq — > £ + £~\ signal, a full reconstruction of the top quark mass mzj is possible 
and straightforward, but the possibility of a combinatorial background arises since there is no 
unambiguous way to pair multiple light-quark jets with the Z boson. Therefore all possible 
combinations are examined. 

The invariant mass of the W and b jet system (m^b) can be reconstructed by assuming that the 
transverse components of the neutrino momentum are given by the missing transverse energy 
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4 Signal Reconstruction 
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Figure 1: Comparison between data and simulated events for an integrated luminosity of 
5.0 fb -1 , after the basic event selection described in Section [3] and requiring at least two jets, 
for: (a) the missing transverse energy distribution, (b) the reconstructed tv transverse mass of 
the W boson candidate, and (c) the scalar sum of the transverse energy for the jets, charged 
leptons, and neutrino, Sj. The data are represented by the points with error bars and the 
open histogram shows the expected signal assuming B(t — > Zq) is equal to 1%. Stacked solid 
histograms represent the dominant backgrounds. 



vector information, while the longitudinal component is calculated as 



Pzv 



PztiPxePxv + PyiPyv + m w 2 /2) ± E t yj (p x ep X v + PylPyv + m w 2 /2) 2 - E 2 V (E 2 - p 2 zf ) 



E 2 



Pie 



where Eg, p x £, p y g, and p z ( are the energy and momentum components for the lepton, while 
the neutrino Ej v , p xv and p yv are estimated from the reconstructed missing transverse energy 
magnitude and direction, and imposing the constraint that the invariant mass of the lepton and 
the neutrino is equal to the W-boson mass (mw). If the discriminant is found to be negative, 
it is set equal to zero. In events in which there are two possible solutions for p zv , the solution 
with the smaller magnitude of p zv , is taken; studies with simulated signal events show that this 
solution is the correct one more than 60% of the time. 



4.1 S T Selection 
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Next, we add the requirements on jets, mzj, and mwb to the basic selection described in Sec- 
tion [3j and search for tt — > Wb + Zq in two ways. One selection requires a minimum value 
of Sj and loose requirements on mzj and mwb- The second selection is stricter, with tight re- 
quirements on the m^ and quantities and the requirement that one of the jets should be 
consistent with the hadronization of a b quark, namely a "b jet". In this Letter, we refer to these 
two selections as the "St" and "b-tag" selections, respectively. The first selection is the more 
sensitive and hence is taken as the reference analysis. Table [2] shows the estimates of the signal 
efficiency determined from simulated events. 

Table 2: Signal selection efficiency for each three-lepton channels in percent. The efficiency is 
calculated as the fraction of events with leptonically (e, \i, t) decaying W and Z bosons passing 
the selection. Only statistical uncertainties are shown. 



Channel 


S T Selection [%] 


b-tag Selection [% 




eee 


(12.4 ± 1.1) 


(3.8 ± 0.6) 


eeji 


(13.8 ± 1.2) 


(5.0 ± 0.7) 


m e 


(14.8 ± 1.2) 


(5.1 ± 0.7) 


m 


(14.7 ± 1.2) 


(5.3 ± 0.7) 



4.1 S T Selection 

In the St selection, at least two jets with pj > 30GeV are required, which are assumed to 
come from the primary vertex. A constituent track candidate in a jet is removed from the 
reconstruction if it does not point to the same vertex, but there is no association requirement 
between jets and the Z candidate. 

A candidate event is required to have St above 250 GeV, m^ and are required to be be- 
tween 100 GeV and 250 GeV and the reconstructed tt pair that has the largest separation in 
azimuthal angle is selected. 

Figure|2](top) shows the comparison of the distributions of m^j and in data and simulation 
after the basic event selection described in Section [3] (Table [l}, combined with the two or more 
jets and the St requirements. 

4.2 b-tag Selection 

To further reduce the background from diboson events, a b-tag based selection is performed. 
In this selection, the two jets are required to be associated with the primary vertex associated 
with the Z candidate and one of the two jets is a b jet. 

The b jets are identified by the track counting high-efficiency b-tagging algorithm described in 
Ref. HUJ, which relies on tracks with large impact parameter significance. This tagging method 
has an identification efficiency of 65% to 85% for b jets with transverse momentum between 
30 GeV to 100 GeV and a misidentification rate below 15%. 

The reconstructed top quark mass m^j is required to be within 25 GeV of the assumed top quark 
mass, m t = 172.5 GeV, while mwb is required to be within 35 GeV of m t . 

Figure |2](bottom) shows the comparison between data and simulated events for m^j and 
after the basic event selection and requiring at least two jets, one of which is a b jet. 
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4 Signal Reconstruction 
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Figure 2: Comparison between data and simulated events of the mzj and distributions 
after the basic event selection described in Section [3] for an integrated luminosity of 5.0 fb -1 , 
requiring at least two jets and: (Top) the minimum Sj value, as required in the Sj selection; 
(Bottom) exactly one b jet as required in the b-tag based selection. The data are represented by 
the points with error bars and the open histogram is the expected signal assuming B(t — > Zq) 
is equal to 1%. Stacked solid histograms represent the dominant backgrounds. The last bin 
contains all the overflow events. The red dotted lines show the boundaries of the allowed mass 
region. 
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5 Background Estimation 

Backgrounds are estimated from the yields of simulated events passing the full selection for 
WW, WZ, ZZ, and single top production, while estimates based on data are made for Drell- 
Yan and tt backgrounds. The uncertainties in the background estimation given below include, 
in order, the statistical and systematic components. 

The WZ and ZZ production are the dominant diboson backgrounds. The production of W pairs 
has a higher cross section, but is unlikely to contain both an extra high-px lepton and a b jet. 
The diboson background estimates are 13.6 ± 0.2 ± 2.6 (0.72 ± 0.01 ± 0.15) and 1.09 ± 0.02 ± 0.21 
(0.058 ± 0.001 ± 0.012) for the WZ and ZZ processes in the Sj (b-tag) selection. These estimates 
are rescaled by 1.3 ± 0.1 to take into account the overall normalization difference observed 
between data and simulation for the zero jet events, after the event selection given in Section|3] 
The single top background is smaller than 0.01 at the 95% CL in both selections. 

The Drell-Yan background is small due to the minimum 30 GeV requirement of missing trans- 
verse energy. Other backgrounds from QCD multijet events in which a jet could be misiden- 
tified as a lepton are negligible. It is possible for SM tt to satisfy the Z selection when both W 
bosons decay leptonically into the same flavor, but the third lepton and the top quark mass 
requirements will reject these events. 

The Drell-Yan and tf background estimates are based on two data samples. The first sample is 
composed of all events satisfying the basic event selection with two or more jets and loose re- 
quirements in Sj, mzj, and m^. The second sample also has loose requirements in Sj, m^j, and 
m^b, but in addition it also has a less stringent isolation criteria for the third lepton. Therefore, 
the second sample is an admixture of the purer three-lepton sample plus events with a misiden- 
tified lepton, originating from jets or heavy-flavor decays, or genuine three-lepton events that 
were lost in the signal sample due to the more stringent isolation requirement. The number 
of events in the two samples are then related by the efficiency of events with nominal lepton 
isolation and the probability of a jet to be misidentified as a lepton. Using the genuine and 
misidentified lepton efficiencies, which are both determined from data, the yield of genuine 
and misidentified three-lepton events is found. This measurement is turned into an estimate 
of the Drell-Yan and tt background after subtracting the contribution from dibosons and tak- 
ing into account the change in acceptances and efficiencies (e.g. b-tagging) after the full signal 
selections are made. The total contribution of Drell-Yan and tt events, after the Sj and b-tag 
selections are estimated to be 1.5 ± 0.5 ± 0.4 and 0.06 ± 0.02 ± 0.01, respectively. These esti- 
mates are compatible with the expectations based on simulated events. The total estimated 
backgrounds are given in Table [3] 

6 Systematic Uncertainties 

The systematic uncertainties come from the trigger efficiency, choice of parton distribution 
functions, lepton selection, pileup modeling, missing transverse energy resolution, uncertainty 
on the tt cross section, b-tagging efficiency for high-px b jets [2l|, and jet energy scale |[TT|. 
The prescription given in [22J is used to determine the uncertainty from the choice of parton 
distribution functions. 

In addition, there is a 2.2% uncertainty on the luminosity measurement II23I . All these sources 
combine to give a 19% (21%) relative uncertainty on the signal acceptance times efficiency in 
the Sj (b-tag) selection. 

The systematic uncertainties are summarized in Table [4l The systematic uncertainty of the 
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7 Results 



Table 3: Background composition, observed and expected yields, and limits at the 95% CL 
for all three-lepton channels combined for the Sj and b-tag selections for an integrated lumi- 
nosity of 5.0 fb -1 . The uncertainties in the background estimation include the statistical and 
systematic components separately (in that order). 



Selection 


St 


b-tag 


WZ background 


13.59 ± 0.20 ± 2.58 


0.718 ±0.011 ±0.150 


ZZ background 


1.09 ±0.02 ±0.21 


0.058 ± 0.001 ± 0.012 


Drell-Yan and tt background 


1.52 ±0.46 ±0.41 


0.055 ±0.017 ±0.012 


Total background prediction 


16.20± 0.51 ± 2.62 


0.83 ± 0.02 ± 0.15 


Observed events 


11 





Expected limit at the 95% CL 


B(t->Zq) <0.36% 


B(t-)-Zq) <0.42% 


Observed limit at the 95% CL 


B(t->Zq) <0.24% 


B(t->Zq) <0.30% 



Table 4: Summary of the systematic uncertainties for the three-lepton signal selection in percent 
for the St and b-tag selections. There is an additional 2.2% uncertainty due to the luminosity 
measurement. 



Source 


St selection 


0/ 

/<) 




b-tag selection 


[%] 


Trigger efficiency 


4 


4 


Parton distribution functions 


6 


6 


Lepton selection 


7 


7 


Pile-up events 


7 


7 


Missing transverse energy resolution 


8 


8 


Cross sections 


8 


8 


b-tagging 





9 


Jet energy scale 


10 


10 


Total 


19 


21 



background estimation is listed with the total background prediction given in Table [3] 

7 Results 

In the St (b-tag) selection, we expect 16.2 ± 2.7 (0.8 ± 0.2) events from the SM background 
processes and we observe 11 (0) events for all four channels combined. No excess beyond the 
SM background is observed and a 95% CL upper limit on the branching fraction of t — > Zq is 
determined using the modified frequentist approach (CLs method |24ll25l ). A summary of the 
observed and predicted yields and limits are presented in Table [3] 

The calculation of the upper limit is based on the information provided by the observed event 
count combined with the values and the uncertainties of the luminosity measurement, the back- 
ground prediction, and the fraction of all tt — > Zq + Wb — > ££q + £b events expected to be 
selected. The signal event yield is obtained from the efficiency times acceptance and branching 
fraction for simulated events. 

The best observed and expected 95% CL upper limits on the branching fraction B(t Zq) 
are 0.24% and 0.36%, respectively, obtained in the St selection from the combined three-lepton 
analyses. The one-sigma boundaries of the expected limit are 0.26 - 0.52%. The correspond- 
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ing observed and expected upper limits, and one-sigma boundaries for the b-tag selection are 
0.30% , 0.42% and 0.30 - 0.56%, respectively. The expected limit for the Sj selection is more 
sensitive. Therefore the corresponding observed limit is taken as the final result. 



8 Summary 

A search for flavor changing neutral currents in top quark decays in tf events produced in 
proton-proton collisions at = 7TeV is presented. A sample of three-lepton events is selected 
from data recorded by CMS during 2011 corresponding to an integrated luminosity of 5.0 fb _1 . 
These events are compatible with a pp — > tt — > Zq + Wb — > ££q + £vb (£ = e, ji) topology. Since 
three-lepton events originating from the SM processes are rare the background contributions 
are small. No excess of events over the SM background is observed and a B(t — > Zq) branching 
fraction larger than 0.24% is excluded at the 95% confidence level. 
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